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ABSTSACT 

A multi-media instructional program in educational 
research vas designed to add structure and uniformity for the 
presentation of course content both on- and off-campus. It vas 
hypothesized that the program voold encourage equivalent performances 
from the on- and off-campus students and alleviate such problems as: 

(1) lack of uniformity in the presentation of course content on- and 
off-campus; (2) four-hour class sessions; (3) lack of supporting 
media materials; and (4) inability of students to grasp the more 
abstract aspects of the course ^content. After one year of the 
program's iiplementation, evaluation of student performance indicated 
little or no difference between the on- and off-campus sections. 
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ABSTRACT 

Georgia Southern College experienced much difficulty in 
attempting to offer off-campus sections of an Introductory Edu- 
cational Research course. The instructors for the course developed 
a multi-media instructional package that was revised to overcome 
such problems as i (1) lack of uniformity in the presentation 
of course content for on- and off-campus classes, (2) four hour 
class sessions, (3) lack of supporting media materials, and 
(^) inability of students to grasp the more abstract aspects 
of the course content. Evaluation of student performance after 
one year indicated little or no differences in the on-campus 
and off-ceimpus sections- u.s.oepartmentofhealth. 
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EQUATING PERFORMANCE OP STUDENTS ENROLLED 
IN ON-CAMPUS AND OPP-CAMPUS SECTIONS 
OP AN EDUCATIONAL RESEARCH COURSE^ 

Dior ing the past few years the School of Education at Georgia 
Southern College had offered a large numter of courses in the 
graduate curriculum in off-campus settings. One notable exception 
to this trend had been the Introductory course in educational 
research that was required of all graduate students pursuing a 
master's degree In education. The primary reason for not offering 
the educational research course In an off-campus setting had been 
a lack of library resources to adequately support the course. 
In addition, Instructional materials employed could not be adapted 
to a variety of settings. These were concerns that needed to be 
dealt with before on-campus and off-campus Instruction could be 
considered equivalent. 

An exception to offering the Introductory research course 
In an off-campus location was made In the Pall of 1971, At that 
time the course was taught at Port Gordon, Georgia, which had been 
previously established as an off-campus gradiiate center for 
Georgia Southern College, The avalllablllty of a library at nearby 
Augusta College plus three libraries at Port Gordon were considered 
sufficient support for the course. 

However, results of course examinations, student projects, and 
course evaluations Indicated on-campus student performance was 
better than student performance In off-campus sections of the course. 
The results were of an Informal nature and no systematic effort 

^Thls project was supported In part by the Faculty Research Fund 
of Georgia Southern College. 
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had been made to examine the differences In performance between 
on-campus and off-campus classes. 

The project described In this paper was designed to prepare 
a multi-media Instructional program In educational research 
that would add structure and provide uniformity for the presentation 
of course content both on and off-campus. It was hypothesized 
that the restilts of these efforts would produce equivalent 
performances by students In both the on-campus and off-carapus 
sections • 

Problems to be Solved 

Some of the problems to be dealt with In the project Included 
(1) lack of iinlformlty in the presentation of course content for 
on and off-campus classes, (2) four hour class sessions, (3) lack 
of supporting media materials, and (4) Inability of students to 
grasp the more abstract aspects of the course content. 
Methods Used to Solve Problems 

The solutions described In this paper evolved over a five 
year period. During that time many Ideas were tried and incor- 
porated in the overall Instructional package; were tried and 
revised? or were tried and abandoned. Of Importance is the notion 
that the process of developing solutions to the problems was 
lengthy and dynamic, and that the resulting procedures described 
in this paper are still in a state of revision. 

Initial steps toward developing a structured format for 
course presentations Involved organizing the subject into content 
areas and writing course objectives for each content area. Course 
content areas and objectives were reevaluated each quarter for 
five years and the ten areas that were finally Included in the 
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instruct 



ional package werei 



1. 



The Literature, the Library, and Research 



2. 



Introduction to Research 



3. 



Research Problems, Hypotheses, and Variables 
Analytical and Descriptive Research 
Experimental Research I - Basic Designs and Concepts 
Experimental Research II - Complex. Designs 



5. 



7. Measurement 

8. Data Collection Techniques I 

9. Data Collection Techniques II 

10. Statistics 

As these two tasks were being accomplished, a series of 
transparencies was developed to ensure the continuity and equivalence 
of class lectures given in different places to different groups. 
The use of the transparencies made it possible to present the 
material uniformly in the many different physical locations in 
which the off-campus sections of the coiirse were required to meet. 
An additional benefit resulting from the use of the transparencies 
was a reduction in the amount of lecture time required. This 
reduction in time made it possible to use small group sessions 
and other instructional methods in the classes. The variety of 
instructional activities, including filmstrips and movies, helped 
to alleviate the weariness resulting from a four-hour class at 
the end of the day. 

However, a problem arose as a result of the transparency 
supplemented lectures. Students expressed dissatisfaction with 
the method because of the increased demand on their note-taking 
ability. Tne increased efficiency of the lectures made it extremely 
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difficult for students to take notes and maintain their attention. 
In order to overcome this problem, copies of all the transparencies 
were made available to the students. In addition to the copies of 
all transparencies used In the coxarse, students were provided 
with copies of all course handouts, key Information to a motion 
picture and f llmstrlp- tapes , and student study guides. These 
materials were bound Into a single volume that students received 
at the beginning of the coxarse. 

This volume of Information entitled A Student Guide for 
Educational Research , became the focal point for the organization 
of the course material. Subsequent revisions of the volume were 
made to Include course objectives, a collection of selected 
readings, and a cross-listing of textbooks on Educational Research 
with "The Guide". A copy of this cross-listing. Is provided In 
the appendix to this paper along with a list of the texts. These 
revisions helped eliminate the need for a text and the book of 
related readings which had been used previously. Multiple copies 
of the texts cross-listed with "The Guide" were provided the libraries 
at both on-and-off campus locations. In addition, copies of 
reference, master ials related to research and the fllmstrips and 
audio tapes used in the course were made availa^ble for student 
use and review. A considerable expenditure was necessary to 
provide the reference materials and the audio-visual equipment. 
A list of the media and materials used in the course are included 
in the appendix of this paper. 

The last element in the instructional package was the evaluation 
system. Five, fifty-item, multlple-choic¥~examlnatlons were 
used along with critical evaluations of research articles, small 
group session evaluations, and a prospectus or proposal suitable 



for a master's thesis. The multiple choice examinations were 

developed over the five-year period that the course materials 
were being put together. Item analysis information was obtained 
from approximately 1,000 subjects^ and adjustments made in 
the tests according to the strengths and weaknesses of the items, 
and the relationship of items to the course objectives. Internal 
consistency reliability estimates of the five tests ranged from 
.85 to .92. Three equivalent forms of the five tests were prepared 
in which only the order of items was varied, and the same set 
of fifty items was used. This procedure was u^ed to insure the 
security of the tests. Security of the tests was difficult to 
maintain due to the variety of locations in which the course 
was taught necessitating many different seating arrangements 
for students . 

Only the total of the five multiple-choice examinations 
was used to compare the differences of the on-carapus and off-campus 

sections of the course. It was felt that the objective exami- 

nations would be a better means of evaluation than the more 
subjective data obtained for the written work of the students. 
Results of Evaluation 

The comparisons of the on~ and off-campus sections of the 
course were made over four quarters of a school year, with the 
comparisons being made after each quarter rather than summed 
over the entire year. 

A plausible explanation about differences between on-and 
off-campus sections would be that they were not equated in 
aptitude at the beginning of the course. In order to determine 
the validity of such an argument, a comparison was made between 
samples of the on-and off-campus students using the Commons 
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Examination Score of the National Teaohars Examlhations as a basis 
for comparison. This test was used as an admission test for 
students in the School of Education • Scores were not available 
for all subjects, but the information available from the two samples 
indicated no significant difference in the means of the two 
groups. The results of the two-tailed t test used to test the 
difference in means are displayed in Table 1. 



Insert Table 1 about here 



Differences in initial aptitude of students in on- and 
off-campus sections of the course did not appear to be the reason 
for subsequent differences in student performance. 

During the year-long evaluation phase of the project, two 
different instructors taught on- and off-campus sections of the 
course. Because of the close association of these instructors 
during the course development and during the evaluation period, 
a relatively high level of uniformity was achieved in the presenta- 
tion of the course content to all sections of the course. 

Results of the year-long evaluation comparing student 
performance in the on- and of f-campus. sect ions of the course 
indicated that there was no significant difference. The results 
of the two-tailed t test used to test the difference in means 
are contained in Table 2. No significant differences were 



Insert Table 2 about here 
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detected over the four qtaarters of the evaluation. These results 
indicated that student achievement on the total of the multiple- 
choice examinations was essentially the same, and that the efforts 
to equate on-campus and off-campus performance were successful. 

A less formal part of the evaluation dealt with the 
attitudes of students toward the course, the quality of student 
written work, and the ability of students to grasp some of the 
more abstract concepts of the course. Subjective data that 
were gathered indicated that in all three of these areas on-campus 
and off-campus sections were equivalent. Additionally, the 
sections involved in the year-long evaluation were improved over 
the groups of students who had enrolled in the course prior to 
the effort to improve instruct ion. That is, written work was 
improved, attitudes toward the course were more positive, and 
student performance on the more abstract topics of experimental 
design, measurement, and statistics was better. A major contri- 
butor to the change in attitude was the more efficient and 
effective use of the fo\ir-hour class periods. Careful attention 
to the presentation of course content during the developmental 
period enabled the instructors to present abstract ideas in a 
more concrete way. Structuring and sequencing of the course 
material seemed to contribute to the improved quality of student 
written work. Again, these outcomes were more subjectively 
evaluated and are subject to the bias of the instructors. 
Conclusions 

A limiting factor to the results of this study is that the 
procedures were developed specifically to solve a localized 
problem. Therefore, the combination of materials that made up 
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the instructional package may not be as effective in other situations. 
The effort made to provide solutions' to the problems of the type 
mentioned in this paper were extensive and, to some degree, expensive. 
However, it seems evident from the results that a highly structured 
approach to instruction, such as the one described in this paper, 
is not likely to be affected by variation in class location. 
A high degree of equivalence in instruction can be maintained 
despite less than optimum conditions. 

Another consideration is that instruction is dependent to • 
a greater or lesser degree on the instructor (s ) , and this factor 
may make replication of the results contained here difficult 
to obtain. It is not a contention of the authors that the 
procedures described in this paper are not subject to variation 
among instructors of the same subject. Rather, a great deal of 
cooperation among instructors is necessary to effectively carry 
out the type of program described here. 

Finally, the fact that this attempt in equating performance 
of on-campus and off-campus sections of an Educational Research 
course was successful does not mean that all such attempts may 
meet with success. It merely demonstrates that it can be done, 
and that these results might encourage others faced with similar 
problems to attempt similar solutions. 
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TABLE 1 



COMPARISONS OF NTE COMMONS SCORES 
FOR ON- AND OFF- CAMPUS STUDENTS 



N 1 S. D. 

On-Campus 104 6l6,2k 53.13 

Off-Campiis 78 62^, 1^^ 51.93 



Dlff =7.90 t = 1.00 (ns) 



TAELE 2 

COMPARISON OP ON-CAMPUS AND OFP-CAKPUS- - " 







SECTIONS OVER 


FOUR 


QUARTERS 












On-Campus 




Off- 


Campus 






Qiaarter 


N 


X S.D. 


N 


X 


S.D. 


Dif f 


t 


1 


^7 


188.^9 22.07 


^0 


179.68 


2/f.53 


8.81 


1.76 


2 


^5 


19^.16 19.52 


18 


183.83 


22.9^ 


10.33 


1.80 


3 


39 


191.10 19.69 


36 


190.39 


22.77 


.71 


.1^ 




30 


18^.17 16.5^ 


^3 


18^.30 


25.58 


-.13 


-.02 
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LIST OP MATERIALS USED IN THE RESEAHCH COURSE 



l6mm Fllmt 

ivanouse D. and Wlckens, T. Statistics At a Glance . New Yorkt 
John Wiley, 1972. 



Fllmstrlps t 

Set of 3 fllmstrlps on EHICi 

ERIC What It Is and How to Use It. 

1. Introduction to ERIC. 

2. Learning to Use Resources In Education. 

3. Doing an ERIC Search. 

Available fromt National Audio Visual Center (GSA) 

Washington, D. C, 20^^09 



Set of ^fllmstrlps on Statistics! 

1. Graphic Presentation 

2. Descriptive Statistics 

3. Inferential Statistics 

^. Correlation, Reliability, and Validity 

Available fromt Westwood Educational Productions 

701 West port Road 
Kansas City, Missouri 6^111 

Popham, Vi. J. Experimental Desl/yis for School Research 
Popham, W. J. Modern Measurement Methods 

Available fromt VIMCET Associates 

P. 0. Box 2^71^ 

Los Angeles, California 9002^ 



Books t 

Mathles, Lorraine. Informat Ion Sources and Services in Education . 
Phi Delta Kappa Fastback #16, Eloomlngton, Indiana, Phi 
Delta Kappa Educational Foundation, 1973. 

Hoenes, Ron L. and Chlssom, Brad S. A Student Guide for Educational 
Research , 2nd Edition, New Yorkt Vog Press^ -1975. 

Available froms Brad Chlssom 

1606 Barak Lane 
Bryan, Texas 77801 
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USING SUPPLEMENTA RY PUBLICATIONS 

The figures on the next page guide you to specific chapters in the 
preceeding list of books which in turn provide you with information on a 
particular Unit or part of a Unit in A Student Guide For Educational Researc n> 

On the left-hand column Units 1 through 10 are listed. Across the top 
of the page are the last names of the author(s) of each publication shov/n in 
its entirety on the preceeding page. The numbers under each author and across 
from each Unit represent chapters or appendixes in the author's publication. 
Some chapters appear more than one time as the information therein deals 
with more than one Unit. 

Example Of Use 

Information presented in class and that appearing in the '-'Guide" is 
totally understandable by you through the first four Units, However, you 
find that there are a number of terms which you are not clear about in Unit V, 
"Experimental Research - Simple Designs/' Refer to Unit V on the next page. 
Under each of the names at the top of the page and across from Unit V appear 
numbers; Best - 6; Borg, Gall - 15; Good - 8; etc. These numbers represent 
the chapters in each of these publications where you could secure the 
information you desire to further define the terms In question. Go to the 
library, acquire one of these publications, read the particular chapter, and 
get that enlightened feeling. 

Instead of one textbook, you have at your fingertips A Student Guide 
For Educational Research, and nine textbooks. 
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SUPPLEMENTARY PUBLICATIONS 



A Student Guide For Educational Research Is the only required publication 

for students enrolled in Educational Research. Due to the purpose and nature 

of the "Guide", at times you may feel a need for more information to clarify 

some point during the course. To assist you in securing this information we 

have listed a number of supplementary research publications below with directions 

on how to use them appearing on the following two pages. At one time or another 

most of these books have been used as a text for this course. A number of copies 

of each publication can be found in the CSC library, with a few copies of each 

on permanent reserve to insure their availability when needed by you, the student 

When borrowing these books, use it and return it as soon as possible so other 

students may have the same benefits of acquiring essential supportive information 

R.L.H. 
B . S . C . 

Ary, Donald, Lucy Cheser Jacobs, and Asghar Razavieh. Introduction t o Re search 
in Education . New York: Holt, Rinehart and Winston, Inc., 1972. 

Best, John W. Research In Education . 2nd Ed. Englewood Cliffs, New Jersey: 
Prentice-Hall, Inc., 1970. 

Borg, Walter R. and Meredith D. Gall. Educational Research; An Introduction . 
2nd Ed. New York: David McKay Company, Inc., 1971. 

Good, Carter V. Essentials of Educational Research: Methodology and Design , 
2nd Ed. New York: Appleton-Century-Crof ts, 1972. 

Kerlinger, Fred N. Foundations of Behavioral Research . 2nd Ed. New York: 
Holt, Rinehart and Winston, Inc., 1973. 

Sax, Gilbert. Empirical Foundations of Educational Research . Englewood Cliffs, 
New Jersey: Prentice-Hall, Inc., 1968* 

Travers, Robert M. W. An Introduction To Educational Research . 3rd Ed. 
New York: The MacMillan Company, 1969. 

Tuckman, Bruce W. Conducting Educational Research . New York: Harcourt Brace 
Jovanovich, Inc., 1972. 

VanDalen, Deobold B. Understanding Educational Research: Art Introduction . 
3rd Ed. New York: McGraw-Hill Book Company, 1973. 
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